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On page 8, line 24, please delete "(corresponding to claim 2)". 
On page 9, line 10, please delete "(corresponding to claim 3)". 
On page 9, line 17, please delete "(corresponding to claim 4)". 
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IN THE CLAIMS : 

In claim 1, line 2, please delete "for" and insert therefor -of-. 
In claim 13, please delete "6 to 13" and insert therefor ~6 to 12--. 
In claim 14, please delete "1 to 13" and insert therefor -1 to 4 

and 6 to 12--. 
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DESCRIPTION 

Language transference rule producing apparatus, 
language transferring apparatus, and program recording 
medium 

Technical Field 

The invention relates to a language transferring 
apparatus which transfers input speech or an input text into 
another language or another literary style, and also to a 
language transference rule producing apparatus which 
produces transference rules for the same. 

Background Art 

Hereinafter, the conventional art will be described 
with taking as an example an apparatus which is one of language 
transferring apparatuses , and which translates input speech 
into another language (hereinafter, referred to as 
interpretation) . 

In an interpreting apparatus, interpretation is 
realized by sequentially interpreting speech recognition 
for transferring an uttered sentence which is input as a 
sound signal into an output sentence that is indicated by 
a word text string, and language translation which receives 
the sentence indicated by the word text string, and then 



- 1 - 



translates it into a sentence of another language. The 
language translating section is configured by: a language 
analyzing section which analyzes the syntactic or semantic 
structure of the input sentence; a language transferring 
section which transfers the input sentence into another 
language on the basis of a result of the analysis; and an 
output sentence producing section which produces a natural 
output sentence from a result of the translation. 

In a case where the speech recognizing section 
erroneously recognizes a part of the uttered sentence, or 
a case where the uttered sentence itself is unnatural in 
both syntactic and semantic meanings, such as those where 
chiming, restating, or the like is inserted into the sentence, 
or where utterance is ended while the sentence has not yet 
been completed, however, there arises a problem in that, 
even when a result of speech recognition is input into the 
language analyzing section, analysis is failed and therefore 
a result of translation is not output. 

In order to solve the problem, a configuration is 
proposed in which a sentence is divided into phrases, 
intraphrase rules and interphrase rules are separately made , 
and incomplete utterance is analyzed by using only the 
intraphrase rules , thereby enabling a result of the analysis 
to be output. (For example, Takezawa and Morimoto : The 
Transaction of the Institute of Electronics and Communication 



Engineers D-II , Vol . J79-D-II ( 12 ) ) . Fig . 14 shows an example 
of intraphrase and interphrase rules of the conventional 
art. In this example, with respect to a corpus example 301 
of "KONBAN, SINGLE NO HEYA NO YOYAKAU ONEGAI NE" , 
intraphrase rules are described in a tree structure such 
as intraphrase rules 302 , on the basis of grammar rules which 
are common also to written language, and interphrase rules 
are described in the term of adjacency probability among 
phrases in a training corpus. For example, the interphrase 
rules are described as shown in interphrase rules 303. 

When an input sentence is to be analyzed, the 
intraphrase rules are sequentially applied to phrases with 
starting from the beginning of the sentence. The input 
sentence is analyzed while the phrases are connected to one 
another so that, for each phrase, phrase candidates of higher 
adjacency probability are adjacent to each other. In this 
sentence analyzing method, even when a part of a sentence 
is erroneously recognized and usual analysis of the whole 
sentence fails , phrases of the portion which does not include 
erroneous recognition can be correctly analyzed. Therefore, 
a scheme is made so that a translation result can be partially 
output by translating only the analyzed partial phrases . 

In order to solve the problem, another method is 
proposed in which, unlike the conventional art in which 
language analysis is performed in accordance with the grammar , 
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parallel-translation phrases of corresponding source 
language and target language sentences are extracted from 
uttered sentence examples including uttered sentences which 
cannot be analyzed by the conventional grammar, a 
parallel-translation phrase dictionary in which the phrase 
pair is described in a form that is generalized as far as 
possible is produced, and language analysis and language 
transference are performed by using the dictionary. (For 
example, Furuse, Sumida, and Iida: The Transaction of 
Information Processing Society of Japan Vol35 f no3 , 1994-3) 
Fig. 15 shows a language transference rule producing 
apparatus of the conventional art. Before interpretation 
is performed, a parallel-translation phrase dictionary is 
previously produced from an uttered sentence 
parallel-translation corpus. Also in this method, in 
consideration a case where a part of words are erroneous 
or omitted, an uttered sentence is divided into phrases, 
and intraphrase rules and dependency rules between the 
phrases are produced. First, a morphological analyzing 
section 3 60 analyzes morphemes of the source language 
sentence and the target language sentence, and transfers 
the sentences into morpheme strings. Next, a phrase 
determining section 3 61 divides the morpheme strings of the 
source language and the target language in the unit of phrase , 
and then produces intraphrase rules and dependency 
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relationship rules between the phrases. In this case f each 
phrase unit is manually determined in consideration that, 
in partial sentences, the correspondence relationships in 
the parallel translation are apparent, in addition that each 
phrase unit is a unit which is semantically consistent. For 
example, a parallel-translation sentence example of M HEYA 
NO YOYAKU 0 ONEGAISHITAINDESUGA" and "I'd like to reserve 
a room" are divided into two parallel-translation phrases 
(a) and (b) , or (a) "HEYA NO YOYAKU" and "reserve a room" , 
and (b) "O ONEGAISHITAINDESUGA" and "I'd like to", and a 
dependency relationship of " (a) 0 (b) SURU" and " (b) to (a) " 
is regularized. The parallel-translation phrases are 
stored in a parallel-translation phrase dictionary 362, and 
the dependency relationship between the phrases which is 
expressed in the form of parallel translation is stored in 
an interphrase rule table 363. This process is performed 
on all uttered sentences included in the parallel-translation 
corpus. This division and dependency relationship of 
phrases are determined depending on semantic information 
of a sentence and factors such as the degree at which the 
sentence is ungrammatical . Therefore, it is difficult to 
automatically determine them for each sentence. 
Conventionally, consequently, they are manually determined . 

In the sentence analyzing means of the first 
conventional example, however, phrases to be handled are 
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language-dependent phrases which are dependent only on the 
source language, and often fail to coincide with phrase units 
of the target language. Therefore, the means has a problem 
in that, even when phrases which are correct in the source 
language are input into the language transferring section, 
it is often that the phrases cannot be finally accepted. 
The scheme of the first conventional example is enabled also 
by using language-independent phrases. In this case, 
analysis of language-independent phrases must be manually 
produced, thereby causing further problems in that the 
development requires a lot of time , and that rule performances 
are distorted by swinging of criteria of the manual 
production. 

In the method of producing a parallel-translation 
phrase dictionary in the second conventional example, there 
is no means for automatically analyzing semantic information 
and grammatical information of an uttered sentence , and hence 
such information must be manually produced. Therefore, the 
method has problems in that the development requires a lot 
of time , and that rule performances are distorted by swinging 
of criteria of the manual production. When the target task 
of an interpreting apparatus is changed, or when the kinds 
of the source language and the target language are changed, 
rules which have been once established cannot be applied, 
and all of the rules must be again produced. Therefore, the 
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development is low in efficiency and cumbersome. 

In the phrase dictionary 362 and the interphrase rule 
table 363 , a phrase unit is determined with placing emphasis 
on the correspondence relationships of the 
parallel-translation corpus, and the phrase unit is not 
evaluated whether it is adequate for recognition by the speech 
recognizing section 364 or not . It is difficult to determine 
a phrase unit while manually judging whether the phrase is 
adequate for speech recognition or not. The method has a 
problem in that, when recognition is performed by using the 
determined phrase, it is not guaranteed to ensure the 
recognition rate. 

Disclosure of Invention 

It is an object of the invention to provide a language 
transferring apparatus which can solve the above-discussed 
problems, in which, even when an input speech sentence 
contains an untrained portion or when speech recognition 
is partly erroneously performed, transference to the target 
language is surely enabled, and in which a phrase dictionary 
and interphrase rules required for transference can be 
automatically produced without requiring much manual 
assistance . 

In order to solve the problems, a first aspect of the 
invention (corresponding to claim 1) is directed to a language 



- 7 - 



transferring apparatus characterized in that the apparatus 
comprises: storing means for storing language rules which 
are obtained by training grammatical or semantic restriction 
rules for a word or a word string from a training database 
in which a sentence that is input in a form of speech or 
text, and that is a target language transference (hereinafter, 
such a sentence is referred to as a source language sentence, 
and a sentence that has undergone language transference 
correspondingly with it is referred to as a target language 
sentence) is paired with a target language sentence 
(hereinafter, such a database is referred to as a 
parallel-translation corpus) ; 

a speech recognizing section which performs speech 
recognition on input speech by using the stored language 
rules, and which outputs a result of the recognition in a 
form of a sentence that is a target language transference; 
and 

a language transferring section which transfers a 
sentence that is a target language transference, into a 
sentence that has undergone language transference, by using 
the same language rules as that used in the speech recognizing 
section . 

Furthermore, a second aspect of the invention 
(corresponding to claim 2) is directed to a language 
transferring apparatus according to the first aspect of the 
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invention and characterized in that the language rules are 
produced by dividing the sentence that is a target language 
transference, and the transferred sentence into portions 
in which both the sentences form semantic consistency 
(referred to as style— independent phrases ) , and making rules 
with separating language rules in the style-independent 
phrases from language rules between the style-independent 
phrases . 

Furthermore, a third aspect of the invention 
(corresponding to claim 3) is directed to a language 
transferring apparatus according to the second aspect of 
the invention and characterized in that the language rules 
are produced by making rules on grammatical or semantic rules 
in the style-independent phrases andconcurrent or connection 
relationships between the style-independent phrases. 

Furthermore, a fourth aspect of the invention 
(corresponding to claim 4) is directed to a language 
transferring apparatus according to the first aspect of the 
invention and characterized in that the apparatus comprises 
a speech synthesizing section whichperf orms speech synthesis 
on the sentence that has undergone language transference, 
by using a same language rules as that used in the language 
transferring section . 

Furthermore, a fifth aspect of the invention 
(corresponding to claim 5) is directed to a language 
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transferring apparatus according to any of the first to fourth 
aspects of the invention and characterized in that the 
apparatus comprises: a rule distance calculating section 
which, for a language rule group which is obtained by 7 among 
the language rules, bundling language rules of a same target 
language sentence as a same category, calculates an acoustic 
rule distance of the sentence that is a target language 
transference of language rules contained in the language 
rule group; and 

an optimum rule producing section which, in order to 
enhance a recognition level of speech recognition, optimizes 
the rule group by merging language rules having a similar 
calculated distance . 

A sixth aspect of the invention (corresponding to claim 
6) is directed to a language transference rule producing 
apparatus and characterized in that the apparatus comprises : 
a parallel-translation corpus; 

a phrase extracting section which calculates a 
frequency of adjacency of words or parts of speech in a source 
language sentence and a target language sentence in the 
parallel-translation corpus, and couples words and parts 
of speech of a high frequency of adjacency to extract partial 
sentences in each of which semantic consistency is formed 
(hereinafter, such a partial sentence is referred to as a 
phrase) ; 
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a phrase determining section which , among the phrases 
extracted by the phrase extracting section, checks 
relationships between phrases of the source language and 
the target language with respect to a whole of a sentence 
to determine corresponding phrases ; and 

a phrase dictionary which stores the determined 
corresponding phrases, 

the phrase dictionary is used when language 
transference is performed, and the language transference, 
when a source language sentence is input, matches the input 
sentence with the corresponding phrases stored in the phrase 
dictionary, thereby performing language or style 
transference. 

Furthermore, a seventh aspect of the invention 
(corresponding to claim 7) is directed to a language 
transference rule producing apparatus according to the sixth 
aspect of the invention and characterized in that the phrase 
determining section checks concurrent relationships between 
phrases of the source language and the target language, 
thereby determines corresponding phrases. 

Furthermore, an eighth aspect of the invention 
(corresponding to claim 8) is directed to a language 
transference rule producing apparatus according to the sixth 
aspect of the invention and characterized in that the 
apparatus further has: a morphological analyzing section 
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parallel-translation corpus into a word string; and 

a word clastering section using part-of -speech which , 
by using a result of the morphological analyzing section r 
produces a parallel-translation corpus in which words of 
a part or all of the source language sentence and the target 
language sentence are replaced with speech part names, and 

the phrase extracting section extracts phrases from 
the parallel-translation corpus in which words are replaced 
with speech part names by the word clastering section using 
part-of-speech . 

Furthermore, a ninth aspect of the invention 
(corresponding to claim 9) is directed to a language 
transference ruleproducingapparatus according to the eighth 
aspect of the invention and characterized in that the 
apparatus has a parallel-translation word dictionary of the 
source language and the target language, and 

the word clastering section using part-of-speech 
replaces words which are corresponded in the 
parallel-translation word dictionary and in which the source 
language is a content word, with speech part names. 

Furthermore, a tenth aspect of the invention 
(corresponding to claim 10) is directed to a language 
transference rule producing apparatus according to the sixth 
aspect of the invention and characterized in that the 
apparatus further has: a morphological analyzing section 
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which transfers the source language sentence of the 
parallel-translation corpus into a word string; and 

a semantic coding section which, by using a result 
of the morphological analyzing section, on a basis of a table 
in which words are classified while deeming words that are 
semantically similar , to be in a same class, and a same code 
is given to words in a same class (hereinafter, such a table 
is referred to as a classified vocabulary table) , produces 
a parallel-translation corpus in which words of a part or 
all of the source language sentence and the target language 
sentence are replaced with codes of the classified vocabulary 
table, and 

the phrase extracting section extracts phrases from 
the parallel-translation corpus in which words are replaced 
with codes by the semantic coding section. 

Furthermore, an eleventh aspect of the invention 
(corresponding to claim 11) is directed to a language 
transference rule producing apparatus according to the tenth 
aspect of the invention and characterized in that the 
apparatus has a parallel-translation word dictionary of the 
source language and the target language, and 

the semantic coding section replaces only words which 
are corresponded in the parallel-translation word dictionary , 
with semantic codes . 

Furthermore, a twelfth aspect of the invention 
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(corresponding to claim 12) is directed to a language 
transference rule producing apparatus according to the sixth 
aspect of the invention and characterized in that the phrase 
extracting section extracts phrases by using also a phrase 
definition table which previously stores word or sentence 
part strings that are wished to be preferentially deemed 
as a phrase, with pairing the source language and the target 
language . 

Furthermore, a thirteenth aspect of the invention 
(corresponding to claim 13) is directed to a language 
transference rule producing apparatus according to any one 
of the sixth to thirteenth aspects of the invention and 
characterized in that the apparatus has a perplexity 
calculating section which calculates a perplexity of a corpus , 
and 

the phrase extracting section extracts phrases by 
using a frequency of adjacency of words or word classes, 
and the perplexity. 

Furthermore, a fourteenth aspect of the invention 
(corresponding to claim 14) is directed to a program recording 
medium characterized in that the medium stores a program 
for causing a computer to execute functions of a whole or 
a part of components of the language transferring apparatus 
or the language transference rule producing apparatus 
according to any one of the first to thirteenth aspects of 
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Brief Description of Drawings 

Fig. 1 is a block diagram showing the configuration 
of a language transferring apparatus in a first embodiment 
of the invention. 

Fig. 2 is a block diagram showing the configuration 
of a language transferring apparatus in a second embodiment 
of the invention. 

Fig. 3 is a view illustrating production of language 
rules in the first embodiment of the invention. 

Fig. 4 is a view illustrating production of optimum 
language rules in the second embodiment of the invention. 

Fig. 5 is a block diagram showing the configuration 
of a language transferring apparatus and a language rule 
producing apparatus in a third embodiment of the invention. 

Fig. 6 is a view illustrating production of language 
transference rules in the third embodiment of the invention. 

Fig. 7 is a view showing an example of a 
parallel-translation interphrase rule table and a 
parallel-translation phrase dictionary in the third 
embodiment of the invention. 

Fig. 8 is a block diagram showing the configuration 
of a language transferring apparatus and a language rule 
producing apparatus in a fourth embodiment of the invention. 



Fig. 9 is a view showing an example of a phrase 
definition table in the fourth embodiment of the invention. 

Fig. 10 is a block diagram showing the configuration 
of a language transferring apparatus and a language rule 
producing apparatus in a fifth embodiment of the invention. 

Fig. 11 is a view illustrating production of language 
rules in the fifth embodiment of the invention. 

Fig. 12 is a block diagram showing the configuration 
of a language transference rule producing apparatus in a 
sixth embodiment of the invention. 

Fig. 13 is a block diagram showing an example of the 
configuration of a language transferring apparatus having 
a speech synthesizing section. 

Fig. 14 is a view showing an example of language rules 
used in a conventional language transferring apparatus. 

Fig. 15 is a block diagram showing the configuration 
of a conventional language transferring apparatus. 
(Description of the Reference Numerals and Signs) 
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Best Mode for Carrying Out the Invention 

Hereinafter, embodiments of the invention will be 
described with reference to the drawings. 

(First embodiment) 

First , a first embodiment will be described. 
In the first embodiment, description will be made by- 
using, as an example of a language transferring apparatus, 
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an interpreting apparatus which performs transference 
between different languages, in the same manner as the 
conventional art examples. Fig. 1 is a block diagram of the 
interpreting apparatus of the embodiment. 

In the interpreting apparatus of the embodiment, 
before interpretation is performed, a language analyzing 
section 2 previously trains language rules of the source 
language sentence and the target language sentence of an 
uttered sentence , from a training database 1 which has a 
parallel-translation corpus, a parallel-translation word 
dictionary , and the like . Fig . 3 shows an example of training 
of the language rules. 

In the language rule producing section 2 , content words 
of the source language and the target language are replaced 
with speech part names by using, for example, a 
parallel-translation corpus to which speech part tags are 
given. In the case where a phrase in the source language 
and that in the target language correspond to each other 
as one bundle, the one bundle is set as style-independent 
phrases and the boundary is delimited. Namely, in the case 
where a style-dependent phrase in the source language and 
that in the target language correspond to each other as one 
bundle, the one bundle is set as the boundary of a 
style-independent phrases. In the case where a 
style-dependent phrase in the target language corresponding 
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to that in the source language do not correspond as one bundle , 
coupling of style-dependent phrases and correction of the 
phrase boundary are performed until corresponding portions 
exist as one bundle, thereby setting the phrases as 
style-independent phrases . Referring to Fig. 3 , sentences 
of the parallel-translation corpus , "KONBAN, HEYA NO YOYAKU 

0 SHITAINDESUGA" and "I'd like to room-reservation tonight" 
2 6 are replaced with speech part names by replacement of 
content words with speech part names 30, as "<common noun> 
| <common noun> NO < M S ,f series irregular conjugation noun> 

1 O SHITAINDESUGA" 27. Furthermore, boundaries are 
delimited as style-independent phrases , or as "<commonnoun>" , 
"<common noun> NO <"S" series irregular conjugation noun>" , 
"O SHITAINDESUGA". In each style-independent phrase, 
thereafter, a mixed string of speech part names and words, 
the name of word of a portion indicted by the speech part 
name, and the frequency of occurrence in the 
parallel-translation corpus of each style-independent 
phrase are described as style-independent intraphrase rules 
3. For all sentences of the parallel-translation corpus, 
the above-mentioned rules are described. In Fig. 3, the 
above-mentioned contents are described in 3 by description 
of intraphrase rules 31. In 3 of Fig. 3, rule 1 has i <common 
noun> | for Japanese, and | <noun> | for English. The speech 
part contents are "KONBAN" for Japanese, and "tonight" for 
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English. If appearing in the parallel-translation corpus, 
also "ASU" , "tomorrow", and the like are described in rule 
1. 

Moreover, concurrent relationships of each 
intraphrase rule are described as style-independent 
interphrase rules 4. When concurrent relationships are to 
be regularized as a phrase bi-gram r for example , the frequency 
of adjacency of style-independent phrases are previously 
described. 

The above-described contents mean that, in Fig. 3, 
description of interphrase rules 32 describes 28. 28 is an 
example of a phrase bi-gram. For example, a rule number pair 
is "(rule 1) (rule 2) 11 and its frequency of occurrence is 
4 . This means that cases where , during a process of training 
from the parallel-translation corpus , rule 1 and rule 2 appear 
side by side in the sentence occurred four times. In the 
example of 28, cases where rule 2 and rule 3 appear side 
by side in the sentence occurred six times. 

Moreover, also the syntax structures between 
style- independent phrases are described in the 
style-independent interphrase rules 4. This mean that, in 
Fig. 3, description of interphrase rules 32 describes 29. 
Since the appearance sequence of style-independent phrases 
in Japanese is different from that in English, the description 
of interphrase rules 32 make sequence relationships to 
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correspond with one another by expressing the language 
structures in a tree form in 25. 

In sentence production rules 5, target language rules 
which lack in the language rules 3 and 4 are described. In 
the case of Japanese-English translation, for example, 
article and indefinite article rules, third person singular 
rules, and the like are described as the contents of the 
sentence production rules. 

The intraphrase language rules 3 and/or the 
interphrase language rules 4 constitute an example of the 
storing means in the invention. 

In the case of interpretation, uttered speech of the 
source language is first input through a microphone 6 into 
a speech recognizing section 7. The speech recognizing 
section predicts sequentially candidates for a recognized 
word in time sequence, from the mixed string of speech part 
names and words described as the style-independent 
intraphrase language rules 3 , and the phrase bi-gram serving 
as the style-independent interphrase language rules 4. A 
sum of an acoustic score based on the distance value between 
a previously trained acoustic model 8 and the input speech, 
and a language score based on the phrase bi-gram is set as 
a recognition score, and a continuous word string serving 
as a recognition candidate is determined by Nbest-search . 
The thus determined continuous word string is input into 
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a language transferring section 9 . In the intraphrase 
language rules 3 and the interphrase language rules 4, the 
rules are previously established while the source language 
and the target language correspond to each other. In the 
language transferring section 9, the continuous word string 
is transferred into phrase strings of the target language 
by using the rules, and then output. In this case, when the 
input phrase string of the source language coincides with 
the syntax structure between phrases which have been already 
trained, the phrase string of the target language is corrected 
in accordance with the syntax structure and then output. 

The output target language sentence is input into an 
output sentence producing section 10 , and grammatical 
unnaturalness is corrected. For example, optimizations 
such as addition of articles and indefinite articles, and 
transference of a verb into the third person singular form, 
the plural form, the past form in a pronoun and a verb, or 
the like are performed . The corrected translation resultant 
sentence of the target language is output, for example, in 
the form of a text. 

In the embodiment described above, when the language 
rules used in speech recognition are to be trained, the rules 
are produced while bundled portions in which both the source 
language and the target language have meaning are used as 
one unit, and recognition is performed on the basis of 



-22- 



restrictions of the rules. Therefore , it is possible to 
realize a language transferring apparatus which can solve 
the problem that, when an input speech sentence contains 
an untrained portion or speech recognition is partly 
erroneously performed, any portion of a translation result 
of the whole sentence is not output, and which can output 
an adequate translation result with respect to a portion 
that has been correctly recognized. 

In the embodiment, the interpreting apparatus has been 
described as an example of the language transferring 
apparatus. This can be similarly used in another language 
transferring apparatus , for example, a language transferring 
apparatus which transfers an unliterary uttered sentence 
into a text sentence in written language. 

(Second embodiment) 

Next, a second embodiment will be described with 
reference to the drawings. In the embodiment also, in the 
same manner as the first embodiment, description will be 
made by using an interpreting apparatus. Fig. 2 is a block 
diagram of the interpreting apparatus of the embodiment. 

In the interpreting apparatus of the embodiment, 
before interpretation is performed , a language rule producing 
section 11 previously trains intraphrase language rules 12 
and interphrase language rules 13 of the source language 
sentence and the target language sentence of an uttered 



sentence , from a training database 1 which has a 
parallel-translation corpus and a parallel-translation word 
dictionary. The trained rules are identical with the 
training of the language rules in the first embodiment . Next , 
the trained language rules are optimized. Fig. 4 shows an 
example of the optimization. 

Among the trained style-independent phrases , phrases 
of the same target language are bundled as the same category. 
Referring to Fig .4,12 denotes language rules . The language 
rules are bundled by rule distance calculation 14, as 
categories as indicated in 33. Rule 1, rule 2, and rule 3 
have the same target language rule of "I'd like to", and 
hence the rules are set into the same category. Since rule 
4has a target language ruleof "please" , therule is classified 
into a category different from that of rule l f rule 2, and 
rule 3. Next, the rule distance calculating section 14 
calculates the acoustic distance between source language 
phrases contained in the same category. In Fig. 4, 15 shows 
examples of the calculated acoustic distance between source 
language phrases. In 15, the distance between rule 1 and 
rule 2 is 7 , and the distance between rule 1 and rule 3 is 
2. 

The acoustic distance of the source language phrases 
contained in the same category rule is calculated in the 
following manner. First, when the parts of sentence are 
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identical with each other , the same word is applied to sentence 
part portions of the mixed string in all the target language 
phrases in the category, and all the mixed strings are 
transferred into word strings. In order to check whether 
the word strings are similar in pronunciation or not, the 
distance with respect to a difference in a character string 
of each word string is then calculated by using (Ex. 1) , 
and then written into the rule distance table 15. When the 
distance between phrase X = {xl, x2 , x3 , ... xn) {where x 
indicates each word) consisting of an n number of words, 
and phrase Y = {yl , y2 , y3 , ... ym) consisting of an m number 
of words is indicated by D(Xn, Yin), 
[Ex. 1] 



D(Xi,Yj) - rain D(Xi-l.Yj) + d(xi,yj) 
D(Xi-l, Yj-1) + d(Xi, Yj) 
D(Xi, Yj-1) + d(Xi,Yj) 
where if xi=yj then d(xi,yj)-0 
else d(xi,yj)=l 



In an optimum rule producing section 16 , only the rule 
of the largest number of occurrences in phrases having a 
distant value which is not larger than a fixed value is left, 
and all the other rules are erased. In the example of Fig. 
4, for example, when the fixed value is set to 2, the rule 
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distance between rule 1 and rule 3 which are in the same 
category in 33 is 2, or not larger than the fixed value of 
2. In the two rules, therefore, rule 1 having a higher 
frequency of occurrence is adopted, and rule 3 is deleted 
from the rules. In accordance with the above, the number 
of occurrences is rewritten. 

After the above-mentioned rule optimization is 
performed on all the rules written in the intraphrase language 
rules 12, only language rules which have not been erased 
are stored as intraphrase optimum language rules 17 . In 
accordance with the optimized rules, the removed rules in 
the interphrase rules 13 are rewritten with the employed 
rules, and also the number of occurrences is corrected. 
Referring to Fig. 4, rule 3 is deleted by optimum rule 
production 16, and united with rule 1. In accordance with 
this, as indicated 17, the occurrence number of rule 1 is 
set to 15 which is a sum of the rule and rule 3 that has 
been deleted. 

In sentence production rules 5, target language rules 
which lack in the language rules produced from the corpus 
are described. In the case of Japanese-English translation, 
for example, article and indefinite article rules, and third 
person singular rules, etc. are described as the contents 
of the sentence production rules. 

In the case of interpretation, uttered speech of the 
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source language is first input through a microphone 6 into 
a speech recognizing section 7. The speech recognizing 
section predicts sequentially candidates for a recognized 
word in time sequence, from the mixed string of speech part 
names and string words described as the style-independent 
intraphrase optimum language rules 17, and the frequency 
of adjacency of phrases as style-independent interphrase 
optimum language rules 18 . A sum of an acoustic score based 
on the distance value between a previously trained acoustic 
model 8 and the input speech, and a language score based 
on a phrase bi-gram is set as a recognition score, and a 
continuous word string serving as a recognition candidate 
is determined by Nbest-search . The thus determined 
continuous word string is input into a language transferring 
section 9. In the language rules 17 and 18, the rules are 
previously established while the source language and the 
target language correspond to each other. In the language 
transferring section 9, the continuous word string is 
transferred into phrase strings of the target language by 
using the rules, and then output. In this case, when the 
input phrase string of the source language coincides with 
the syntax structure between phrases which has been already 
trained , the phrase string of the target language is corrected 
in accordance with the syntax structure and then output. 

The output target language sentence is input into an 
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output sentence producing section 10, and grammatical 
unnaturalness is corrected. For example , optimizations 
such as addition of articles and indefinite articles, and 
transference of a verb into the third person singular form, 
the plural form, or the past form in a pronoun and a verb 
are performed. The corrected translation resultant 
sentence of the target language is output, for example, in 
the form of a text. 

In the embodiment described above, when the language 
rules used in speech recognition are to be trained, the rules 
are produced while bundled portions in which both the source 
language and the target language have meaning are used as 
one unit. Thereafter, when source language phrases having 
the same ruled target language portion are acoustically 
similar to one other, only the rule of the highest frequency 
of occurrence is adopted from the similar rules, and the 
remaining rules are erased. As a result, it is possible to 
realize an interpreting apparatus in which the increase of 
the number of rules due to the setting of a style-independent 
phrase as a unit is suppressed without lowering the 
performance of the language rules as far as possible, and 
therefore recognition and language transference of high 
performance are enabled. 

In the embodiment , the interpreting apparatus has been 
described as an example of the language transferring 



apparatus- This can be similarly used in another language 
transferring apparatus f for example , a language transferring 
apparatus which transfers an unliterary uttered sentence 
into a text sentence in written language. 
(Embodiment 3 ) 

In the embodiment, description will be made by, as 
an example of a language transferring apparatus, using an 
interpreting apparatus which performs transference between 
different languages, in the same manner as the conventional 
art examples. Fig, 5 is a block diagram of the interpreting 
apparatus of the embodiment. 

In the embodiment, a parallel-translation corpus 101 , 
a content word definition table 103 , a parallel-translation 
word dictionary 107 , a morphological analyzing section 102 , 
a word clastering section using part-of-speech 104 , a phrase 
extracting section 105, a phrase determining section 106, 
a parallel-translation interphrase rule table 108, and a 
parallel-translation phrase dictionary 109 constitute an 
example of the language trans ference rule producing apparatus 
of the invention. The parallel-translation phrase 
dictionary 109 of the embodiment is an example of the phrase 
dictionary set forth in claim 6 of the invention. 

In the interpreting apparatus of the embodiment, 
before interpretation is performed, the morphological 
analyzing section 102 analyzes morphemes of the source 
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language sentence in the parallel-translation corpus 101, 
thereby producing a parallel-translation corpus in which 
a speech part tag is given only to the source language sentence . 
For example, in an example of an uttered speech 120 of "HEYA 
NO YOYAKU 0 ONEGA! SHITAINDESUGA" of Fig. 6, speech part tags 
as shown in 121 are given to the source language sentence. 
Next, the word clastering section using part-of-speech 104 
produces a speech part parallel-translation corpus in which 
a part of word names in the source language sentence provided 
with speech part tags in the corpus are replaced with speech 
part names . In this case, it is assumed that a word which 
is to be replaced with a speech part name satisfies the 
following conditions . 

(1) The word corresponds to a part of sentence listed in 
a content word table. 

(2) A word which is registered in the parallel-translation 
word dictionary , and which corresponds to the target language 
translation in the parallel-translation word dictionary 
exists in a corresponding parallel-translation sentence of 
the target language in the corpus. 

In the example of the content word definition table 
103 of Fig. 6, among common nouns, "S" series irregular 
conj ugation nouns , and verbs listed in the content word table , 
only "HEYA" and 11 YOYAKU " registered in the 
parallel-translation word dictionary 107 are replaced with 
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parts of sentences, so that a corpus in which these words 
are replaced with speech part names is produced as shown 
in 122. Furthermore f also the corresponding word names in 
the parallel-translation sentence of the target language 
are replaced with speech part names in Japanese. 

With respect to the corpus in which a part of word 
names are replaced with speech part names, the phrase 
extracting section 105 calculates a frequency of doubly 
chained occurrence (hereinafter, referred to as bi-gram) 
of each word or part of speech. The source language sentence 
and the target language sentence are separately subjected 
to this calculation. The calculation expression is shown 
in (Ex. 2) . 
(Ex. 2) 

{number of cases in which word (or part of speech) i and 
word (or part of speech) j occur adjacently} 



{total number of occurrences of word (or part of speech) 
i + total number of occurrences of word (or part of speech) 
j} 

After a bi-gram is calculated for all of the source 
language sentences and the target language sentences in the 
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corpus , the phrase extracting section 5 couples two words 
or a speech part pair of the highest frequency of occurrence 
to each other, while assuming the words or the pair as one 
word. Then r a bi-gram is again calculated. As a result, 
for example, word pairs such as ,f 0 M and "NEGAI", "NEGAI" 
and "SHI", and "SHI" and "MASU" in each of which the words 
are adjacent at a higher frequency are coupled to one another 
to form a phrase candidate "ONEGAISHIMASU" . In the target 
language, the word pairs of "I'd" and "like", and "like 11 
and "to" are coupled to each other. For each of all of the 
source language sentences and the target language sentences, 
the above-mentioned coupling and calculation of a bi-gram 
are repeated until the values of all bi-grams do not exceed 
a fixed threshold value. Each of words including coupled 
words is extracted as a phrase candidate. 

The phrase determining section 106 calculates the 
frequency at which respective phrases concurrently occur 
in the pair of the source language sentence and the target 
language sentence. When an i-th source language phrase is 
indicated by J[i] and a j-th target language phrase is 
indicated by E[j] , the frequency of concurrence K[i, j] of 
phrases J[i] and E[j] is calculated by a calculation 
expression (Ex. 3) . 



[Ex. 3] 



KCi , j ] - 

{number at which phrase J[i] and phrase E[j] concurrently 
occur in parallel-translation sentence pair} 

{number of occurrences of phrase J [i] + number of occurrences 
of phrase E [ j ] } 

In an example of Fig. 7, for example, among three 
parallel-translation sentences 130 which are described as 
phrase strings, the frequency of concurrence of 
"ONEGAISHIMASU 11 of the source language phrase and "I'd like 
to" of the target language phrase is 2/(2 + 3) r and that 
of "SHITAINDESUGA" and the target language phrase is 1/(1 
+ 3) . A phrase pair in which the frequency is not smaller 
than a fixed value is determined as parallel-translation 
phrases , and then registered together with the frequency 
and a phrase number in the parallel-translation phrase 
dictionary 109 . Among phrase candidates which have not been 
determined as parallel-translation phrases, a word which 
has been already replaced with a speech part name is singly 
registered as a parallel-translation phrase in the 
parallel-translation phrase dictionary 109. With respect 
to the other portion, each corresponding word strings in 



-33- 



the parallel-translation pair are registered as a pair in 
a phrase dictionary. 

In the example of Fig. 7 , for example, phrases are 
registered in the parallel-translation phrase dictionary 
109 as indicated by 131. 

After phrases are registered in this way, phrase 
numbers which concur in one sentence are recorded, and then 
registered as a phrase number pair in the 
parallel-translation interphrase rule table 108, as 
indicated by 132 in the example of Fig. 7. 

Moreover, a phrase bi-gram of the phrase number pair 
is obtained, and also the phrase bi-gram is recorded in the 
parallel-translation interphrase rule table 108. Namely, 
the source language corpus is expressed by a string of phrase 
numbers which are registered in the parallel-translation 
phrase dictionary, a phrase bi-gram is obtained by using 
a corpus expressed by phrase numbers, and also the obtained 
bi-gram is recorded in the parallel-translation interphrase 
rule table 8. A phrase bi-gram indicating an occurrence 
probability of phrase j successive to phrase i is expressed 
by (Ex. 4) . 



[Ex. 4] 



{number of cases in which phrase i and phrase j occur adj acently 
in this sequence} 



{occurrence number of phrase i} 

In 132 of Fig. 7, for example, a phrase bi~gram of 
phrase 3 and phrase 1 is obtained. With respect to the 
interphrase rule of phrase 4 , phrase 5 , and phrase 2 , bi-grams 
of phrase 4 and phrase 5 , and phrase 5 and phrase 2 are'obtained 
respectively , and then recorded in the parallel-translation 
interphrase rule table 108. 

In the case of interpretation, uttered speech of the 
source language is first input into a speech recognizing 
section 110. The speech recognizing section 113 predicts 
sequentially candidates for a recognized word in time 
sequence , from a network of words which are written as phrases 
in the parallel-translation phrase dictionary 109 and the 
phrase bi-gram written in the parallel-translation 
interphrase rule table 108 . A sum of an acoustic score based 
on the distance value between a previously trained acoustic 
model 113 and the input speech, and a language score based 
on the phrase bi-gram is set as a recognition score, and 



a continuous word string serving as a recognition candidate 
is determined by Nbest-search . 

The recognized continuous word string is input into 
a language transferring section 111. In the language 
transferring section 111, the input continuous word string 
is transferred into phrase strings in the 

parallel-translation phrase dictionary 109 , and interphrase 
rules corresponding to the respective phrase strings are 
searched. The recognition resultant sentence of the input 
source language is transferred into a target language 
sentence from the target language phrases which are 
parallel-translations of the phrases, and the interphrase 
rules of the target language. 

As described above , in the embodiment, the 
parallel-translation phrase dictionary 109 and the 
parallel-translation interphrase rule table 108 are used 
in both the speech recognizing section 110 and the language 
transferring section 111. 

The transferred target language sentence is input into 
an output sentence producing section 112 , and syntactactical 
unnaturalness is corrected. For example, optimizations 
such as addition of articles and indefinite articles, and 
transference of a verb into the third person singular form, 
the plural form, or the past form in a pronoun and a verb 
are performed. The corrected translation resultant 



sentence of the target language is output, for example, in 
the form of a text. 

In the embodiment described above , rules are described 
in the form in which a source language phrase corresponds 
to a target language phrase, and recognition is performed 
in the unit of the phrase . Therefore , a language transferring 
apparatus is enabled in which, even when a portion of an 
input sentence is an unknown portion sentence or when speech 
recognition is partly erroneously performed, a portion that 
has been correctly recognized and analyzed is appropriately 
processed and output. Furthermore, parallel-translation 
phrases and interphrase rules are automatically determined 
by using the frequency of adjacency of words or parts of 
speech in each of the source language sentence and the target 
language sentence, and concurrent relationships of word 
strings or speech part strings of a high frequency in the 
parallel translation, and interpretation is performed by 
using the parallel-translation phrase rules. Therefore, a 
language rule producing apparatus is enabled which can 
automatically and efficiently produce a 

parallel-translation phrase dictionary of a high quality 
without requiring much manual assistance. 

In the embodiment , the interpreting apparatus has been 
described as an example of the language transferring 
apparatus. This can be similarly used in another language 
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transferring apparatus , for example, a language transferring 
apparatus which transfers an unliterary uttered sentence 
into a text sentence in written language. 
(Embodiment 4) 

In the embodiment also, as an example of a language 
transferring apparatus , description will be made by using 
an interpreting apparatus which performs transference 
between different languages, in the same manner as the third 
embodiment. Fig. 8 is a block diagram of the interpreting 
apparatus of the embodiment. 

In the embodiment, a parallel-translation corpus 101 , 
a content word definition table 103 , a parallel-translation 
word dictionary 107 , a morphological analyzing section 102 , 
a word clastering section using part-of-speech 104 , a phrase 
extracting section 142, a phrase determining section 143, 
a parallel-translation interphrase rule table 145, a 
parallel-translation phrase dictionary 144, and a phrase 
definition table 141 constitute an example of the language 
transference rule producing apparatus of the invention . The 
parallel-translation phrase dictionary 144 of the embodiment 
is an example of the phrase dictionary set forth in claim 
6 of the invention. 

In the interpreting apparatus of the embodiment, 
before interpretation is performed, morphemes are first 
analyzed, and a parallel-translation corpus in which a speech 
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part tag is given is then produced in the same manner as 
the third embodiment. 

Next, in accordance with the phrase definition table 
141 in which word or speech part strings that are wished 
to be extracted as a phrase are previously described with 
being regularized, the phrase extracting section 142 couples 
words or parts of speech corresponding to the rules. In an 
example of 141 of Fig. 9, for example, n 0 + (verb) + TAI" 
are coupled as words in accordance with rules such as "verb 
+ auxiliary verb" and "case particle + verb" . With respect 
to the corpus in which a part of content words are replaced 
with speech part names and such word or speech part strings 
are coupled to be deemed as one word, a frequency of doubly 
chained occurrence (hereinafter, referred to as bi-gram) 
of each word or part of speech is calculated. The source 
language sentence and the target language sentence are 
separately subjected to this calculation. The calculation 
expression is identical with (Ex. 2). 

In the same manner as the third embodiment , the process 
is repeated until the values of all bi-grams do not exceed 
a fixed threshold value. Each of words including coupled 
words is extracted as a phrase candidate. The phrase 
determining section produces the parallel-translation 
phrase dictionary 144 and the parallel-translation 
interphrase rule table 145 in the same manner as the third 
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embodiment. In Fig. 9, 151 is an example of the corpus in 
which words or parts of speech are coupled in accordance 
with the phrase definition table, and 152 is an example of 
the produced parallel-translation phrase dictionary 144. 

In interpretation also, the embodiment operates in 
the same manner as the third embodiment. 

In the embodiment described above , words or parts of 
speech are coupled in accordance with rules of word or speech 
part strings which are wished to be deemed as previously 
defined phrases, and thereafter parallel-translation 
phrases and interphrase rules are automatically determined 
by using the frequency of adjacency of words or parts of 
speech in each of the source language sentence and the target 
language sentence, and concurrent relationships of word 
strings or speech part strings of a high frequency in the 
parallel translation, and language or style transference 
is performed by using the parallel-translation phrase rules . 
Therefore, it is possible to provide a language transference 
rule producing apparatus which can produce a 
parallel-translation phrase dictionary of a high quality 
at a higher efficiency, in a range in which manual assistance 
is suppressed to a minimum level. 

The parallel-translation phrase in the embodiment is 
an example of the corresponding phrases in the invention. 

In the embodiment, the interpreting apparatus has been 
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described as an example of the language transferring 
apparatus. This can be similarly used in another language 
transferring apparatus , for example, a language transferring 
apparatus which transfers an unliterary uttered sentence 
into a text sentence in written language. 
(Embodiment 5) 

In the third embodiment, construction of language 
rules which aremore general andhave ahigh quality is realized 
by, when the rules are to be constructed, replacing a part 
of words in the corpus with speech part names. Even when 
words are replaced with semantic codes in place of speech 
part names, it is expected to attain the same effects. 
Hereinafter , the embodiment will be described with reference 
to Fig. 10. In the embodiment also , description will be made 
by using an interpreting apparatus which performs 
transference between different languages. 

In the embodiment , a parallel-translation corpus 201 , 
a classified vocabulary table 216, a parallel-translation 
word dictionary 207 , a morphological analyzing section 202 , 
a semantic coding section 215, a phrase extracting section 
205 , a phrase determining section 206 , a parallel-translation 
interphrase rule table 208 , andaparallel-translationphrase 
dictionary 209 constitute an example of the language 
transference rule producing apparatus of the invention . The 
parallel-translation phrase dictionary 2 09 of the embodiment 



is an example of the phrase dictionary set forth in claim 
6 of the invention. 

In the interpreting apparatus of the embodiment, the 
morphological analyzing section 202 analyzes morphemes of 
the source language sentence in the parallel-translation 
corpus 201, thereby giving speech part tags to the source 
language sentence. Next, in the morpheme strings of the 
source language sentence, the semantic coding section 215 
compares morphemes with words written in the classified 
vocabulary table 216 . With respect to a morpheme coinciding 
with a word to which a semantic code is given in the classified 
vocabulary table 216, the morpheme name is replaced with 
the semantic code, thereby transferring an input morpheme 
string into a morpheme string in which a part of morphemes 
are replaced with semantic codes . In this case , it is assumed 
that a morpheme to be replaced with a semantic code satisfies 
the following conditions, 

(Conditions) A word which is registered in the 
parallel-translation word dictionary , and which corresponds 
to the target language translation in the 
parallel-translation word dictionary exists in a 
corresponding parallel-translation sentence of the target 
language in the corpus . 

In the example of Fig. 11, only "HEYA" and "YOYAKU" 
which are registered in the parallel-translation word 
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dictionary, and to which a code is given in the classified 
vocabulary table are replaced with semantic codes, so that 
a morpheme string in which these morphemes are replaced with 
semantic codes is produced as shown in 2132. Furthermore, 
also the word names in the parallel-translation sentence 
of the target language are replaced with semantic codes as 
shown in 2133 . 

With respect to the corpus in which a part of content 
words are replaced with semantic codes , the phrase extracting 
section 205 calculates a frequency of doubly chained 
occurrence of each wordor semantic code . The source language 
sentence and the target language sentence are separately 
subjected to this calculation. The calculation expression 
is shown in (Ex. 5) . 
(Ex. 5) 

{number of cases in which word (or semantic code) i and word 
(or semantic code) j occur adjacently} 



{total number of occurrences of word (or semantic code) i 
+ total number of occurrences of word (or semantic code) 

j} 

After a bi-gram is calculated for all of the source 
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language sentences and the target language sentences in the 
corpus, the phrase extracting section couples two words or 
a semantic code pair of the highest frequency of occurrence 
to each other, while assuming the words or the pair as one 
word. Then, a bi-gram is again calculated. As a result, 
for example, word pairs such as "0" and "NEGAI", "NEGAI" 
and 11 SHI", and "SHI" and "MASU" in each of which the words 
are adjacent at a higher frequency are coupled to one another 
to form a phrase candidate "ONEGAISHIMASU" . In the target 
language, the word pairs of "I'd" and "like", and "like" 
and "to 11 are coupled to each other. 

For each of all of the source language sentences and 
the target language sentences, the above-mentioned coupling 
and calculation of a bi-gram are repeated until the values 
of all bi-grams do not exceed a fixed threshold value. Each 
of words including coupled words is extracted as a phrase 
candidate . 

In the same manner as the third embodiment, the phrase 
determining section 206 determines parallel-translation 
phrases, and registers the phrases in the 
parallel-translation phrase dictionary 209. Moreover, in 
the same manner as the third embodiment , interphrase language 
rules and phrase bi-grams are produced, and then registered 
in the parallel-translation interphrase rule table 208. 

In interpretation also, the embodiment operates in 
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the same manner as the third embodiment. 

In the embodiment described above , rules are described 
in the form in which a source language phrase corresponds 
to a target language phrase, and recognition is performed 
in theunit of the phrase . Therefore , a language transferring 
apparatus is enabled in which, even when a portion of an 
input sentence is an unknown portion sentence or when speech 
recognition is partly erroneously performed, a portion that 
has been correctly recognized and analyzed is appropriately 
processed and output- Furthermore, parallel-translation 
phrases and interphrase rules are automatically determined 
by using the frequency of adjacency of words or semantic 
codes in each of the source language sentence and the target 
language sentence, and concurrent relationships of word 
strings or semantic code strings of a high frequency in the 
parallel translation, and interpretation is performed by 
using the parallel-translation phrase rules. Therefore, a 
language rule producing apparatus is enabled which can 
automatically produce a parallel-translation phrase 
dictionary of a high quality without requiring much manual 
assistance . 

In the embodiment , the interpreting apparatus has been 
described as an example of the language transferring 
apparatus. This can be similarly used in another language 
transferring apparatus , for example, a language transferring 



apparatus which transfers an unliterary uttered sentence 
into a text sentence in written language or the like. 
(Embodiment 6) 

In the fifth embodiment, when the language rules are 
to be constructed, a phrase is produced by coupling a word 
or a part of speech, or a semantic code of a high frequency 
of adjacency. Alternatively, the perplexity of a sentence 
may be evaluated after a phrase is produced, whereby a phrase 
which has a higher quality and can ensure a recognition rate 
can be produced. 

Hereinafter , an embodiment of the language transference 
rule producing apparatus will be described with reference 
to Fig. 12. 

A parallel-translation phrase dictionary of the 
embodiment is an example of the phrase dictionary set forth 
in claim 6 of the invention. 

In the same manner as the previous embodiment, after 
morpheme analysis, a semantic coding section 213 produces 
a parallel-translation corpus in which a part of morphemes 
are transferred into semantic codes. Furthermore, the 
phrase extracting section calculates a bi-gram of each word 
or semantic code . The source language sentence and the target 
language sentence are separately subjected to this 
calculation. The calculation expression is identical with 
(Ex. 5) . 
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In the same manner as the previous embodiment , the 
process is repeated until the values of all bi-grams do not 
exceed a fixed threshold value. Each of words including 
coupled words is extracted as a phrase candidate. 

When, in the above process, a bi-gram of each word 
or semantic code is calculated and a coupling process is 
performed depending on the value of the bi-gram, a perplexity 
calculating section 218 calculates perplexities of cases 
where word pairs are coupled, and where word pairs are not 
coupled, and then compares the perplexities. A perplexity 
is calculated by (Ex. 6) . 
[Ex. 6] 

Perplexity F = 2 H(L> 

H(L) - - ZP(Wi|Wi-l)logP(WiiWi-l)/M 

where P(Wi|Wi-l) : probability that an i-th morpheme is Wi 
when an (i - l)-th morpheme is Wi-1, and M : number of kinds 
of two-word chains in all corpuses. 

A phrase extracting section 217 removes away phrases 
which are proved as a result of the comparison that the 
perplexity is increased by coupling words or semantic codes, 
from the phrase candidates. 

On phrases which remain as phrase candidates after 
the above process, determination of phrases is performed 
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under the same conditions as that of the previous embodiment , 
and a parallel-translation phrase dictionary 209 and an 
interphrase rule table 208 are determined. 

In the embodiment described above, when 
parallel-translation phrases are to be determined, 
determination is performed by using a perplexity of a 
parallel-translation corpus in which words are classified 
by means of semantic codes. Therefore, 

parallel-translation phrases can be automatically extracted 
from a corpus, and a parallel-translation phrase dictionary 
of a high quality can be efficiently produced without 
requiring much manual assistance. The criterion of a 
perplexity is closely related with that of determination 
on whether a phrase is appropriate for speech recognition 
or not. Therefore, phrase extraction can be automatically 
performed while ensuring recognition accuracy. 

In the embodiment, the example wherein phrase 
extraction is performed by handling a corpus in which a part 
of words are replaced with semantic codes has been described. 
Even when phrase extraction is performed by handling a corpus 
in which a part of words are replaced with speech part names , 
it is expected to attain the same effects. 

In the fourth embodiment, the example in which the 
parallel-translation corpus to which speech part tags are 
given is handled and phrases are extracted in accordance 
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with the phrase definition table has been described. Also 
in the case where, as described in the fifth embodiment,, 
a corpus in which a part of words are replaced with semantic 
codes is used and phrases are extracted in accordance with 
the phrase definition table, it is expected to attain the 
same effects. 

In the first to fifth embodiments, description has 
been made assuming that the language transferring apparatus 
is conf iguredby the speech recognizing section, the language 
transferring section, and the output sentence producing 
section. The configuration is not restricted to this. As 
shown in Fig. 13, a speech synthesizing section which performs 
speech synthesis on the translation resultant sentence output 
from an output sentence producing section 212 may be disposed . 
The speech synthesizing section performs speech synthesis 
by using the parallel-translation interphrase rule table 
208 and the parallel-translation phrase dictionary 209 which 
are identical with those used in a speech recognizing section 
210 and a language transferring section 211 in speech 
synthesis. According to this configuration, even when an 
input speech sentence contains an untrained portion or speech 
recognition is partly erroneously performed, the problem 
that any portion of a speech synthesis result of the whole 
sentence is not output can be solved, and it is expected 
that an adequate speech can be output with respect to a portion 
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that has been correctly recognized. 

The whole or a part of functions of components of the 
language transferring apparatus or the language transference 
rule producing apparatus of the invention may be realized 
by using a dedicated hardware, or alternatively by means 
of software with using computer programs. 

Also a program recording medium which is characterized 
in that the medium stores a program for causing a computer 
to execute the whole or a part of the functions of the 
components of the language transferring apparatus or the 
language transference rule producing apparatus of the 
invention belongs to the invention. 

Industrial Applicability 

As apparent from the above description, the invention 
can provide a language transference rule producing apparatus 
and a language transferring apparatus which can output a 
recognition result that can be surely transferred into a 
target language sentence, and in which, even when a portion 
of an input sentence is an unknown portion sentence or when 
speech recognition is partly erroneously performed , a portion 
that has been correctly recognized and analyzed is therefore 
appropriately processed and output. 

Furthermore, the invention can provide a language 
transference rule producing apparatus and a language 
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transferring apparatus in which , even when an input speech 
sentence contains an untrained portion or speech recognition 
is partly erroneously performed, transference of only a 
portion which has been correctly recognized and to which 
an adequate analysis rule is applied is enabled, and it is 
possible to surely output a partial transference result. 

Furthermore, the invention can provide a language 
transference ruleproducingapparatus in which language rules 
is enabled to be automatically produced without requiring 
much manual assistance. 

Furthermore, the invention can provide a language 
transference ruleproducingapparatus in which language rules 
of a high quality is enabled to be automatically produced 
at a higher efficiency without requiring much manual 
assistance . 

Furthermore , the invention can provide a language 
transference rule producing apparatus in which language rules 
of a high quality is enabled to be automatically produced 
at a higher efficiency. 
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Amended claims 

1. A language transferring apparatus characterized 
in that said apparatus comprises: storing means for storing 
language rules which are obtained by training grammatical 
or semantic restriction rules for a word or a word string 
from a training database in which a sentence that is input 
in a form of speech or text, and that is a target language 
transference (hereinafter , such a sentence is referred to 
as a source language sentence , and a sentence that has 
undergone language transference correspondingly with it is 
referred to as a target language sentence) is paired with 
a target language sentence (hereinafter, such a database 
is referred to as a parallel-translation corpus) ; 

a speech recognizing section which performs speech 
recognition on input speech by using the stored language 
rules, and which outputs a result of the recognition in a 
form of a sentence that is a target language transference; 
and 

a language transferring section which transfers a 
sentence that is a target language transference, into a 
sentence that has undergone language transference, by using 
the same language rules as that used in said speech recognizing 
section . 

2 . A language transferring apparatus according to 
claim 1 , characterized in that the language rules are produced 
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by dividing the sentence that is a target language 
transference, and the transferred sentence into portions 
in which both the sentences form semantic consistency 
(referred to as style-independent phrases) f and making rules 
with separating language rules in the style-independent 
phrases from language rules between the style-independent 
phrases . 

3 . A language transferring apparatus according to 
claim 2 , characterized in that the language rules are produced 
by making rules on grammatical or semantic rules in the 
style-independent phrases and concurrent or connection 
relationships between the style-independent phrases. 

4. A language transferring apparatus according to 
claim 1, characterized in that said apparatus comprises a 
speech synthesizing section which performs speech synthesis 
on the sentence that has undergone language transference, 
by using a same language rules as that used in said language 
transferring section . 

5 . A language transferring apparatus according to any 
one of claims 1 to 4, characterized in that said apparatus 
comprises: a rule distance calculating section which, for 
a language rule group which is obtained by r among the language 
rules j bundling language rules of a same target language 
sentence as a same category, calculates an acoustic rule 
distance of the sentence that is a target language 
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transference of language rules contained in the language 
rule group; and 

an optimum rule producing section which , in order to 
enhance a recognition level of speech recognition, optimizes 
the rule group by merging language rules having a similar 
calculated distance. 

6. A language transference rule producing apparatus 
characterized in that said apparatus comprises: 

a parallel-translation corpus; 

a phrase extracting section which calculates a 
frequency of adjacency of words or parts of speech in a source 
language sentence and a target language sentence in said 
parallel-translation corpus, and couples words and parts 
of speech of a high frequency of adjacency to extract partial 
sentences in each of which semantic consistency is formed 
(hereinafter, such a partial sentence is referred to as a 
phrase) ; 

a phrase determining section which, among the phrases 
extracted by said phrase extracting section, checks 
relationships between phrases of the source language and 
the target language with respect to a whole of a sentence 
to determine corresponding phrases; and 

a phrase dictionary which stores the determined 
corresponding phrases, 

said phrase dictionary is used when language 
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transference is performed, and the language transference, 
when a source language sentence is input, matches the input 
sentence with the corresponding phrases stored in saidphrase 
dictionary, thereby performing language or style 
transference . 

7. A language transference rule producing apparatus 
according to claim 6, characterized in that said phrase 
determining section checks concurrent relationships between 
phrases of the source language and the target language, 
thereby determines corresponding phrases. 

8. A language transference rule producing apparatus 
according to claim 6, characterized in that said apparatus 
further has: a morphological analyzing section which 
transfers the source language sentence of the 
parallel-translation corpus into a word string; and 

a word clastering section using part-of-speech which , 
by using a result of said morphological analyzing section, 
produces a parallel-translation corpus in which words of 
a part or all of the source language sentence and the target 
language sentence are replaced with speech part names, and 

said phrase extracting section extracts phrases from 
the parallel-translation corpus in which words are replaced 
with speech part names by said word clastering section using 
part-of-speech . 

9. A language transference rule producing apparatus 
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according to claim 8, characterized in that said apparatus 
has a parallel-translation word dictionary of the source 
language and the target language, and 

said word clastering section using part-of-speech 
replaces words which are corresponded in said 
parallel-translation word dictionary and in which the source 
language is a content word, with speech part names. 

10. A language transference rule producing apparatus 
according to claim 6, characterized in that said apparatus 
further has: a morphological analyzing section which 
transfers the source language sentence of the 
parallel-translation corpus into a word string; and 

a semantic coding section which, by using a result 
of said morphological analyzing section, on a basis of a 
table in which words are classified while deeming words that 
are semantically similar, to be in a same class, and a same 
code is given to words in a same class (hereinafter, such 
a table is referred to as a classified vocabulary table) , 
produces a parallel-translation corpus in which words of 
a part or all of the source language sentence and the target 
language sentence are replaced with codes of the classified 
vocabulary table, and 

said phrase extracting section extracts phrases from 
the parallel-translation corpus in which words are replaced 
with codes by said semantic coding section. 
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11. A language transference rule producing apparatus 
according to claim 10, characterized in that said apparatus 
has a parallel-translation word dictionary of the source 
language and the target language, and 

said semantic coding section replaces only words which 
are corresponded in the parallel-translation word dictionary , 
with semantic codes. 

12 . A language transference rule producing apparatus 
according to claim 6, characterized in that said phrase 
extracting section extracts phrases by using also a phrase 
definition table which previously stores word or sentence 
part strings that are wished to be preferentially deemed 
as a phrase, with pairing the source language and the target 
language . 

13 . A language transference rule producing apparatus 
according to any one of claims 6 to 13 , characterized in 
that said apparatus has a perplexity calculating section 
which calculates a perplexity of a corpus, and 

said phrase extracting section extracts phrases by 
using a freguency of adjacency of words or word classes, 
and the perplexity. 

14. A program recording medium characterized in that 
said medium stores a program for causing a computer to execute 
functions of a whole or a part of components of the language 
transferring apparatus or the language transference rule 
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producing apparatus according to any one of claims 1 to 13 . 
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ABSTRACT 

When a portion of an input speech sentence contains 
an untrained portion or when speech recognition is partly 
erroneously performed, transference to the target language 
is disabled. Moreover, a phrase dictionary and interphrase 
rules which are necessary for transference must be manually 
produced. Therefore, development is low in efficiency and 
requires much labor. 

An apparatus includes: a language rule producing 
section which statistically automatically trains 
grammatical or semantic restriction rules for a partial word 
or a word string from a parallel-translation corpus, and 
in which rules are described in the form wherein a source 
language partial sentence corresponds to a target language 
partial sentence ; a speech recognizingsection whichperf orms 
speech recognition on speech of the source language by using 
the produced language rules, and which outputs a result of 
the recognition; and a language transferring section which 
transfers a source language sentence into a target language 
sentence by using the same language rules. Even when a 
portion of an input speech sentence contains an untrained 
portion or when speech recognition is partly erroneously 
performed, transference to the target language is surely 
enabled. Moreover, a phrase dictionary and interphrase 
rules which are necessary for transference can be 
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automatically produced without requiring much manual 
assistance . 
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Declaration and Power of Attorney For Patent Application 

English Language Declaration 

As a below named inventor, 1 hereby declare that: 

My residence, post office address and citizenship are as stated below next to my name, 

believe I am the original, first and sole inventor (if only one name is listed below) or an original, 
irst and joint inventor (if plurat names are listed below) of the subject matter which is claimed 
and for which a patent is sought on the invention entitled Language transference rule 
producing apparatus, language transferring apparatus, and program recording 



the specification of which is attached hereto unless the following box is checked: medium 
3 was filed on 02 June 1999 as 

United States Application Number or PCT International Application Number PCT/JP 99/02954 

and was amended on (if applicable). 

hereby state that I have reviewed and understand the contents of the above identified 
specification, including the claims, as amended by any amendment referred to above. 

acknowledge the duty to disclose information which is material to patentability as defined in 37 
CFR § 1.56. 

I hereby claim foreign priority benefits under 35 U.S.C. §119(a)-(d) or § 365(b) of any foreign 
appiication(s) for patent or inventor's certificate, or § 365(a) of any PCT International application 
which designated at least one country other than the United States, listed below and have also 
identified below by 1 checking the box, any foreign application for patent or inventor's certificate, 
or PCT Internationa) application having a filing date before that of the application on which priority 
is claimed: 

Prior Foreign Application(s) Priority Not Claimed 





Hei10-155,550 


JAPAN 


June 4, 1998 






(Number) 


(Country) 


(Day/Month/Year Fifed) 


a 




Hei1 1-039,253 


JAPAN 


February 17, 1999 




(Number) 


(Country) 


(Day/Month/Year Filed) 


o 




Hei1 1-041 ,186 


JAPAN 


February 19, 1999 


□ 




(Number) 


(Country) 


(Day/Month/Year Filed) 



I hereby claim the benefit under 35 U.S.C. 5 1 19(e) of any United States provisional application^ 
listed below. 



(Application Number). (Filing Date) 



(Application Number) (Filing Date) 

I hereby claim the benefit under 35 U.S.C. § 120 of any United States application(s), or 365(c) o 
any PCT International application designating the United States, listed below and, insofar as the 
subject matter of each of the claims of this application is not disclosed in the prior United States 
or PCT International application in the manner provided by the first paragraph of 35 U.S.C. § 1 12 
I acknowledge the duty to disclose information which is material to patentability as defined in 37 
CFR § 1.56 which became available between the filing date of the prior application and the 
national or PCT international filing date of this application: - 
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Patent and Trademark Office-US, DEPARTMENT OF COMMERCE 
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{Application Number) 



(Filing Date) 



{Status - patented, pending, abandoned) 



(Application Number) 



(Filing Date) 



(Status - patented, pending, abandoned) 



POWER OF ATTORNEY: As a named inventor, 1 hereby appoint the following attorney(s) and/or 
agent(s) to prosecute this application and transact all business in the Patent and Trademark Office 
connected therewith: 



Paul F. Prestia 
Altan Ratner 
Andrew L Ney 
Kenneth N. Nigon 
Kevin R. Casey 
Benjamin E. Leace 
James C Simmons 



Reg.NoJ^OSSI 
Reg.No. 19,717 

Reg. N 6720300^2 
Reg.No. J31J49 
Reg.No.JgJIXL. 
Reg.No J&412^ 
Reg.No. c 24,842.^ 



Lawrence E. Ashery 
Robert L. Anderson 
Christopher R. Lewis 
Louis W. Beardell, Jr. 
Rocco L. Adornato 
Jacques L Etkowicz 
Eric A. Dichter 



Reg.No34 t 515..„ 
Reg.No. 25,771 
RegNQg^oT 
Reg.No. 4O506_ 
Reg.Nd^SI 
Reg.NqJ0J38- 
Reg.No. 41 ,708, 



Mark J. Marcelli 
Christopher J. Dervishian 



Reg.No. 36,593 
Reg.No^ 42,480 



Address all correspondence to: 

,il atner & fo^^^ P-O- Box 980. Valley Forge. PA 19482-0380 ^, 

Sddress all telephone calls to:3ZZ at (610) 407-0700. 

d hereby declare that all statements made herein of my own knowledge are true and that all 
statements made on information and belief are believed to be true; and further that these 

^statements were made with the knowledge that willful false statements and the fike so 
jnade are punishable by .fine or imprisonment, or both r under Section 1001 of Title 18 of the 

United States Code and that such willful false statements may jeopardize the validity of the 
^application or any patent issued thereon. 



full name of sole or first inventor (given name, family name) Yumi WAKITA 



4fiventor , s signature 



Date November 15, _2 00C 



Residence Ji^-shi, Nar£ JAPAN VTFjf 
Citizenship ^PAN ^ r 

Post Office Address 68-3 05, Turumai-higashimachi 1-chome, Nara-shi, Nara 631-0021 

JAPAN 

Full name of second joint inventor, if any (given name, family name) m 



Second Inventor's signature. 

Residence 

Citizenship 

Post Office Address 



Date 



Q Additional inventors are being named on separately numbered sheets attached hereto. 
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United States Patent & Trademark Office 

Office of Initial Patent Examination - Scanning Division 




Application deficiencies found during scanning: 
d Pagers^) * oj, 5 of ^PX'A^hAv^j were not present 

for Scanning. (Document title) 



□ Page(s) of . were not present 

for scanning. (Document title) 



□ Scanned copy is best available. 



